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Abstract 

The word error rate (WER) of soft-decision-decoded binary block codes rarely has closed-form. Bounding 
techniques are widely used to evaluate the performance of maximum-likehhood decoding algorithm. But the existing 
bounds are not tight enough especially for low signal-to-noise ratios and become looser when a suboptimum decoding 
algorithm is used. This paper proposes a new concept named square radius probability density function (SR-PDF) 
of decision region to evaluate the WER. Based on the SR-PDF, The WER of binary block codes can be calculated 
precisely for ML and suboptimum decoders. Furthermore, for a long binary block code, SR-PDF can be approximated 
by Gamma distribution with only two parameters that can be measured easily. Using this property, two closed-form 
approximative expressions are proposed which are very close to the simulation results of the WER of interesting. 

Index Terms 

Binary block codes, bounds, decision region, square radius probabiUty density function, word error rate. 

I. Introduction 

The performance evaluation of binary block codes with soft-decision-decoding in additive white Gaussian noise 
(AWGN) and fading channels has long been a problem in coding theory and practice. A closed-form expression of 
word error rate (WER) for popularly used long codes hasn't been derived as yet. Thus, bounding techniques are 
widely used for performance evaluation of maximum-hkelihood (ML) decoding. The most popular upper bound is 
the union bound. When the weight enumerating function of a code is known, union bound presents a tight upper 
bound at signal-to-noise ratios (SNRs) above the cutoff rate hmit but becomes useless at SNRs below the cutoff 
rate hmit [1]. Based on Gallager's first bounding technique [2], some tighter upper bounds are presented [3] [4] 
[5]. These bounds are tighter relative to union bound. But even Poltyrev's tangential sphere bound [6], which has 
been believed as the tightest bound for binary block codes, still has a gap to the real value of WER [7] [8] [9]. 
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Additionally, these bounds are all based on ML decoding, which is too complex to implement in practice. When a 
suboptimum decoder is used, the WER will change but these bounds still keep their original value. 

In this paper, a new concept named square radius probability density function (SR-PDF) of decision region is 
proposed to calculate the WER precisely at SNRs of interesting and any decoding algorithm. The basic premise is 
that in AWGN channel, when the encoder and decoding algorithm are given, the decision region is fixed, and WER 
is completely determined by the decision region. The SR-PDF proposed in this paper is unique for every encoder- 
channel-decoder models, thus any changes of channel and decoding algorithm can be reflected by it. Furthermore, 
when the codeword length iV ^ oo, the asymptotic WER is exactly the complementary cumulative distribution 
probability of the normalized square radius and can be roughly characterized by the maximum point of the SR-PDF. 
Moreover, for popular long codes such as Turbo codes. Low-density parity check (LDPC) codes and Convolutional 
codes, etc, their SR-PDFs are close to Gamma distribution, which implies that the exhausting measurement of 
SR-PDF is not needed, and only the mean and variance of the square radius are enough to get an approximated 
SR-PDF. Based on these properties, two closed-form approximative expressions of WER are proposed and their 
approximation errors are around the order of O.ldB and 0.3dB respectively for WER above 10^'\ 

The rest of this paper is organized as follows: Section II introduces the system model and the concept of SR- 
PDF of decision region, as well as the method of measuring the pdf. In section III, the WER in AWGN channel 
is derived using SR-PDF and several examples are followed to prove the validity of the proposed method. Section 
IV illustrates some important asymptotic properties of the relation of WER to the normalized SR-PDF. In section 
V, two closed-form approximative expressions are derived for WER calculation. Section VI extending the SR-PDF 
method to flat fading channel. The conclusion is drawn in section VII, including some discussion and remarks on 
the SR-PDF method and other applications. 



II. Preliminaries 

A. System Model 

The following system model is used in the paper. Binary information bits are first encoded to binary block code. 
The code rate is R= k/N, where N is the codeword length and k is the information length. Then encoded bits 
are BPSK modulated (the resulting signal set is S), and transmitted in AWGN channel. The received signal is 

y = s + n (I) 

where s = [si, S2, sjv]'^ G S, Si G {±^/El = ±^/REh}, Eg and are, respectively, the energy per code bit 
and the energy per information bit. n = [ni, 712, ...njv]^ is the additive white Gaussian noise with zero-mean and 
variance In this paper, SNR (signal to noise power ratio) is defined as /3 = It is also assumed that the 
signal s is detected coherently and decoded with some algorithm at the receiver, and the channel side information 
is known if it is required. 
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B. Decision Region and Square Radius Probability Density Function 

The decision region Vs of signal s is a set in N dimensional Euclidean space R^. Consider the decoder as a 
function that maps the received vector y to a transmitted signal s G S, f decoder ■ R-^ ^ S, then the decision region 
can be defined as Vg — {y|y G R^, fdecoder{y) = s}, i.e. the domain of s. Whenever the decoder is specified, the 
decision region is fixed. When the received vector y lies inside Vg, it will be correctly decoded to s, otherwise a 
decoding error occurs. For linear block codes investigated in this paper, all the codewords have the same decision 
region. Fig. [T] is an example of two dimensional decision region, where n is the additive noise, 6 is the direction 
of n. Point p is on the boundary of decision region and the radial originated from s along 9. Connecting s and p, 
the length of vector r{9) is the radius of the decision region along the direction of n. Define l{9) = |r(6')|^ as the 
square radius in the direction of 9. Because n is a random variable, so l{9) is a random variable. The pdf of l{9) 
is denoted as pi{l) and is abbreviated as SR-PDF. This concept can be extended to N dimensional space, where 9 
is determined by iV — 1 angles (e.g. azimuth and elevation in three dimensional space). 

The SR-PDF is too complex to work out in analytical way for long codes, but it can be measured with simulation: 
For the system model above, generate a white Gaussian noise vector n = (ni, n2, ...tiat), normalize n to n' = 
= where 9 is the direction of n, scale n' by A and send the vector y = s + An' to the decoder There 

exists a A > such that fdecoderi^ + ^^') = s, VA < A and fdecoderi^ + An') 7^ s, VA > A . In this paper, we 
will assume that the decision region is simply connectecj^ Consequently, |r(9)| = A is the radius in direction of 
n, and 1{Q) = A^ is the square radius. Note that r(9) is related to the code bit energy and codeword length. This 
effect can be removed by normalizing the square radius by NEg, i.e. Z„ = jyTT- resulting SR-PDF is refen^ed 
to as normalized SR-PDF and is denoted as pi^{ln) hereafter. With sufficient tests, the approximated normalized 
SR-PDF can be obtained. 

Fig. |2] is the normalized SR-PDF of Turbo codes with different codeword lengths, code rates and decoding 
algorithms in AWGN channel. Turbo codes used in this paper is defined in [13]. Obviously, all the changes in the 
encoder and decoder will be reflected by the SR-PDF. Larger decision region implies that the code can tolerate larger 
noise, therefore, the SR-PDF which occurs in the righter side will have a better WER performance. Subsequent 
sections will mainly discuss the relation between SR-PDF and WER. 

III. Word Error Rate In AWGN Channel 

In AWGN channel, the decision region and the corresponding SR-PDF is completely determined whenever the 
decoder is specified, no matter whether it is a maximum likelihood (ML) decoder like the Viterbi decoding for 
Convolutional codes or a suboptimal decoder such as the iterative decoders for Turbo and LDPC codes. For a 
binary linear block code, all the codewords have the same error rate. Therefore, without loss of generality, assume 

'Note that when iterative decoding algorithm is used for Turbo and LDPC decoding, as the iteration increases, it is possible, particularly on 
very noisy channel, for the decoder to converge to the correct decision and then diverge again [10]. i.e. it is possible that s + Ain' can be 
decoded in error even if /decoder (s + A2n') = s, where Ai < A2. This implies that the decision region of iterative decoder may not be a 
simply connected region, but the probability of this exception is much smaller than the WER. 
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a codeword s e S is transmitted. The word error rate is the probabihty that the received vector y ^ 1^ conditioned 
on s, that is 



Pe = 1 - <j> p{y\s)dy 

Vs 

= 1 - ^ P (y - s) rfy ^2) 

V,-s 

= 1 — <j) p{n) dn 

where = V"s — s is the shift of the decision region from s to origin. Denoting n in polar coordinates, ^ becomes 

Pe - I - <l>Pp,B (p,e) dpdQ 

= 1 - ^ Pp\6 {p)pe{B)dpdQ 

^ (3) 



= 1 - 



Pp\e (p) dp 



p>|r(9)| 



p<k(9)l 

Pp\e {p) dp 



Pe (9) dQ 



Pe (6) dQ 



p>\r(e]\ 



Pp\e (p) dp 



Note that the integral in the bracket is the decoding error probability conditioned on the direction of a noise 
realization, so 



(4) 



Pe\e = / Pp\e {p) dp 

Jp>\r{e)\ 

= P[p>\rm] 

= p[p'>m] 

Expectation over 9 is equivalent to expectation over I, thus the average error probability is 

Pe^Ee[Peie] ^Ei[P{p^>l)] 
P i^p^ > Pi (x) dx 

/ P{p^ > NEsx) pi^ (x) dx 
Jo 



(5) 
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where = |n| 
pdf of X is 



N 



^ nf. Define x = p^, then x is chi-square distributed [11] with N degrees of freedom. The 

i=l 



p{x) 



N^''^T{N/2)' 



(6) 



where r(a:) is the gamma function [12]. When x is an integer and x > 0, T{x + 1) = a;! (the factorial of x). So 



NEJ„ 



1 



N^^^T {N/2) 

JV/3i„/2 



rW2) Jo 
1 



e X 2 dx 



(7) 



r(A^/2) 



7 



N Nj3k 
Y' 2 



where "f(a,x) is the incomplete gamma function defined as [12] 



7(a,x) 



when a is an integer [12], 



dt, a > 



Q-l 



7(a,a;) = (a-l)! U - e"^ ^ 



m=0 



substitute (|7]) into (|5]l, 

Pe - £^6 [Peie] = El [P > ?)] = [ 

Jo 



1 



r(iv/2) 



7 



N N(3x 
Y' 2 



pi^X^)dx 



(8) 



(9) 



(10) 



( [TOj l show that, WER of linear binary codes under AWGN channel is completely determined by the normalized 
SR-PDF through a one dimensional integral. 

Simulations are used to verify ( 10 1. Three error control codes commonly used in wireless communications are 
considered, including Convolutional codes [12], Turbo codes [12] and LDPC codes [14]. Fig.[3]is the comparison of 



WER between simulation and that evaluated from ( 10 1. For the simulation, each point on the curve is obtained by 
10^ tests; For the results of (lOi, 10^ radius are measured to get which is then substituted into (lOi to get 



the WER. Fig. 3(a) shows the WER of Turbo code for different maximum iterations. The parameter is = 576, 



i? = 1/3 and the decoding algorithms ai-e Log-MAP and Max-log-MAP. Fig. 3(b) are the WERs of Turbo, LDPC 
and Convolutional codes with different code lengths and code rates. The decoding algorithms are log-MAP with 8 
maximum iterations for turbo code, soft Viterbi algorithm for Convolutional code, sum-product algorithm (SPA) and 
min-sum algorithm (MSA) with 25 maximum iterations and layered decoding for LDPC codes. It can be seen from 
these figures that the WER evaluated from ( [TO) l matches very well with the simulation results except for large SNRs. 
The mismatch in large SNR region maybe caused by the inaccurateness of the simulation, or the inaccurateness of 
the "left tail" (this will be further explained in section IV) of pi^{ln), both of which are difficult to be measured 
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precisely owning to infinitesimal probability. Moreover, the SR-PDF method can trace the change of decoder, e.g. 
the number of iterations, any modifications of the algorithm and etc. while the bounds such as union bound and so 
on cannot do this. 



IV. Asymptotic Properties of WER 



Eq.( 10 1 shows that the WER of a binary linear code is completely determined by the normaUzed SR-PDF, pi^ (x). 
When the codeword length, N oo, there are some asymptotic properties of WER which will be discussed in this 
section. 

Property 1: Define t —\/(3 and P° as the WER when codeword length iV — > oo, i.e. P^{t) — lim Pe{N,(3) 



where Pe{N,P) is defined by (lOi. Then, P^{t) is exactly the cumulative distribution function (CDF) of the 
normalized square radius: 



P,'^(r)= lim Pe{N,P) 

N^OQ 



1/13 .r 

pi^{x)dx ^ / pi^{x)dx = Fi^{t), 
Jo 



where Fi^{x) is the CDF of normaUzed square-radius In- 
Proof: Define 

T{a) T{a) 



t>0, a>0 



It is obvious that f{a, 0) = and f{a, oo) = 1. Taking derivative with respect to t. 



dt T{a) 

For a large a, T{a) can be approximated with Stirling's Series [12] 

T(a) ^ e-"a"-5%/2^ |1 + — + — - 
^ ' \ 12a 288^2 



t > 



e-"a""5V27r 



Substitute into ( pj) ) 



The term te^ * is always less than 1 when t ^ 1. Thus, 



dt e-"a""3V27r 



a 
2^ 



(tei-*)", t>0 



(11) 



(12) 



(13) 



(14) 



(15) 



Of Ml 

fv^no (Jt , . 

OO 1=1 



(16) 



/(a, t) is a continuous function of t. Therefore, as a approaches infinity, f{a, t) approaches to a unit step function: 



Q— >oo L [a) 



f{a, oo) = 1 t > 1 
/(a,0) = 0<i<l 



(17) 



Applying to ([TO]) will obtain ( [TT] l 
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This property can also be explained with the law of large numbers: Dividing and I (9) in (j?]) by codeword 
length N 

(18) 



N N 



N 



because = S "^f ' where n|,i = l,2,...iV are independent and identically distributed (i.i.d) variables and 

1=1 

E{nf) = based on the law of large numbers 



lim P ■ 



N 

E 

1=1 



No 

N 2 



N 13 



< 



(19) 



where e is a positive number arbitrarily small, jigj l implii 
infinity. Based on ( fTS) and ( [T9] l 



ies that ^ approaches a constant, as N approaches 



N 



lim Pe\6^P 



N 13 

1 ^>lu{Q) 
else 



P 



13. 



(20) 



Substituting (20i into (MOb will get (11 



The conditional WER i.e. the term in the square bracket of (10 1 is a decreasing function around In — 1/(3 
with respect to Z„. This is illustrated in Fig |5] together with the SR-PDF pi^{ln). The WER of (lOl is the integral of 
the product Pe\e{Pln)pi„ {In)- It is clear that when SNR is high, WER is dominated by the left tail of the normalized 
SR-PDF. 

Property 2: The inflection point tq of P^{t), is the maximum point of the normalized SR-PDF. 



Proof: Based on property 1, taking the second derivative of (111 with respect to t 

d^P^ir) ApiSr) 



dT2 



dr 







(21) 



The result tq that make (21 1 equal to zero is the inflection point of P° and must be the maximum point of p/^(r). 



The inflection point tq tells the position where the WER curve falls rapidly. Define critical SNR as the inverse 
of the inflection point: 

/3c = l/ro (22) 

then /3c can be viewed as a single parameter which can be used to characterize the WER performance of long codes. 
This has been shown in Fig. |6] where we have drawn the simulated WER with liner coordinates. For the popular 
codes, the normalized SR-PDF tends to be symmetric about the maximum point and the normalized SR-PDF pi^{x) 
arrives to its maximum roughly at jii^^ = E[ln]- Thus, the critical SNR of a code can be approximated as (3c ^ ^ 
The critical SNRs of the codes in Fig. |3(b)| are listed in Table [I] 
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Property 3: For the capacity achievable codes, decision region is a multi-dimensional sphere with constant radius. 
The inverse of the normalized square radius, i.e. the critical SNR /3c, is the Shannon limits. By "Shannnon limit", it 
means such a threshold SNR (3s that for a given family of codes with fixed code rate and codeword length iV — > oo, 
if the channel SNR is greater than (3^, the code will be decoded successfully, otherwise, if SNR is less than f3s, the 
decoding process will fail. 

Proof: Based on [To] and [35] 



Kir)^ / pi^ix)dx^{ (23) 




The f3g that satisfy 23 is unique for the given family of codes, thus with the definition of (3^, it is clearly that 
Ps = (3c- 23 implies that pi„{x) = S{x — -0-), where 6{x) is the Dirac impulse function. A random variable with 6 
pdf is in fact a constant which is also the mean. Thus the decision region must be a sphere with constant radius. ■ 

It is well known that threshold SNR of iterative soft-decision decoding can be obtained by means of Density 
Evolution [16] [17] or the equivalent (Extrinsic Information Transfer) EXIT chart [18] [19] [20]. So property 3 
implies that measuring the average square radius of the decision region is another way to determine threshold SNR. 
For the Turbo code in Table]!] which is exactly the same as the one used in [17], the threshold SNR obtained with 
Density Evolution can be found in [17] as 0.70dB for 1/2 code rate and 0.02dB for 1/3 code rate, the difference 
with (3c is within 0.07dB. For the 1/2 code rate LDPC code in Table ]l] its EXIT chart is shown in Fig]4] where 
the two curves intersect until Ie^ = 1 implying that the threshold SNR is about 0.98dB, while the critical SNR 
obtained from /i/^ is 0.92dB, the difference is 0.06dB. 

Note that though the threshold SNR is generally viewed as a kind of analytical value, this value can only 
be obtained via numerical simulations with possible approximations (such as Gaussian approximation [16] [17]). 
Therefore, it is hard to say which one among f3c and (3s is more accurate. 

Property 3 has provided us a simple method to estimate the asymptotic performance (Shannon limit) for a given 
family of code. We only need to measure the mean of the square-radius with a code of adequate length because 
the mean is independent of codeword length if the code family is given. Note that measuring the mean is much 
simpler than measuring the pdf, with our experience, 1000 radius is enough to get a relatively accurate result. 

The difference between good codes (the codes that can achieve Shannon limits when N — > oo) and practical 
codes is that. The WER of good codes falls steeply at the critical SNR while the WER of practical codes falls in 
a rolling off fashion around the critical SNR. Define as the range corresponding to -P°(t) falls from 1 — e to 
e, where < e ^ 1, i.e. 

A, ^ ri_, - r, = F^-\l - e) - Ff^^e) (24) 

Then A^ can be viewed as a measure of perfectness of practical codes compared with the good codes. If the code 
is capacity achievable, the WER is a step function thus A^ — 0. Otherwise, A^ will be a positive number The A^ 
for codes in Fig. J3]d are listed in table ]I] 
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Assume that pi^ (r) is symmetrical about the mean /x;^ when codeword length ^ oo, is bounded by 



A, < i/2a/Je (25) 
where af is the variance of Z„. This is because that, with the Chebyshev Inequality: 

2e = ^||r-ro| > ^1 < ^ (26) 
In practice, the WER falhng range in decibel domain may be more interesting, i.e. 



A,(dB) = 10 logio - = 10 logio (27) 



The Chebyshev bound now changes to 



e 



A,(dB) < lOlog.o - lOlogio ^ "^^TTW (28) 

The bounds in dB for codes in Fig. [3j) are also listed in table [l] It is obvious that the bound is quite loose, roughly 
3 ~ 5 times larger. 



V. Approximation of WER 



Eq.dOi involves an integration of the product of incomplete gamma function and SR-PDF. Moreover, accurate 
measurement of SR-PDF requires a large number of decoding tests. Thus, it is inconvenient for practical use, and 



approximation formulas will be welcome. The approximation of (10 1 is to approximate the normalized SR-PDF 
pi^{x). Although other approximations such as Gaussian are also possible, it is found that Gamma approximation 
is more accurate. The pdf of Gamma distribution is given by 



p{x) 



1 



(29) 



where a and h are the parameters of Gamma distribution that have the following relationship with /i;,^ and uf [15]: 



Substitute ([291 into ([TO}, 



P. 



1 



h-V{a) 



x^-^e 



(30) 



TV Nfix 
r(iV/2) ' V 2"' 2 



dx 



(31) 
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For long codes, increasing code length from to + 1 generally brings no notable performance difference. So 
assuming that N is even and recalling (|9|, the WER can be simpUfied as 



^ &°r(a)m! 



, 1 / 1 I Ni3j: 



>dx 



E 
y 

mBia,rn) 

m=0 ^ ' ^ 



6'^r(a)r(m + 1) 



/ \ m-\-a 



, , x(2 + JV/36) 

-2;™+°-ie 55 — 



(32) 



r(a+m) '■'^^ ^^^'^ Function [12] and u = jy^'^^^ < 1. The advantage of (|32|) over 



10 1 is that 



t, TDl \ T(a)T{m) 

where B(a,m) — ^ ' ^ — - 

only iii^ and af need to be measured. In the viewpoint of statistics, the number of radiuses required to estimate 
fj,i^ and af is much smaller than to estimate the SR-PDF. Table |ll] lists the mean and variance of Z„ and a, b for 
some codes in AWGN channel. 

Fig. |7] is the comparison of WER between simulation and approximation using (32i. It can be seen that the 
approximation for all the codes only deviates from the simulation within about O.ldB for WER above 10^^. If the 
error floor of approximated Turbo code WER does not occur at high Ei,/Nq, this is a nice approximation for WER 
of interest with a significantly lower computational complexity. 

For a large codeword length, the WER expression can be further simplified using property 1 in section III. 



Substitute (|29J into ((TT), the WER can be approximated as 

1 



„a-l 



6°r(a) 



e dx 



(33) 



1 



T{a) 



1 a 



1 



In (33 1, rounding a to its lower integer and recalling (j9]l, the WER can be approximated as 



ya\-i 

m— 



(34) 



p4) i and ( [32] i use the same parameters to approximate WER. p4] i is simpler to evaluate but less accurate than ( [32] i. 
Fig. [8] is the comparison between simulation WER and approximation of (34i. Similar to the result of Fig. [7] If 
the error floor of Turbo code does not occur within the range that WER is above 10^'^, the approximation result 
deviate from the simulation within about 0.3dB. 



When ( 32 1 and ( 34 1 are appUed to evaluate the WER, an important problem is how accurate should the parameters 
a and h be measured. Generally, for a long code a possesses a large value. It can be verified that the term 
in ([32| is insensitive to the error of a, and the last few terms in the summation of (|34]l are very small (on the order 



of two magnitudes lower than the sum). Thus an error of a within ±1 is safely acceptable for the WER evaluation. 
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The parameter b only occurs in ( 34 1 in the form of product f3b. Thus, an error of b by AdB is equivalent to that b 
is exact but f3 (SNR) is biased by —AdB. From Fig. |7]and Fig. |8] it can be observed that the accuracies of (32 1 



and (34 1 are on the order of 0.1 dB and 0.3dB respectively, therefore, the measurement error of b should be less 
than O.ldB. Several hundreds of radiuses are generally enough for this requirement. 

VI. Word Error Rate In Flat Fading Channel 
In flat fading channel, ([T]i changes to 



y = diag(h) • s + n 



(35) 



where h = [/ii, /12, /iat]^ is the channel gain, which scales every element of the transmitted vector. Thus, the 
decision region is dependent on a specific channel vector. Given the channel vector, the conditional WER can be 
calculated by (lOi with pi^{ln) be replaced by Pi^\h{ln) which is the normalized SR-PDF conditioned on a channel 



vector. The average WER for flat fading channel is then obtained by taking expectation over all possible h: 



1 - 



V{N/2) ' V 2 ' 2 



N N(3x 



T{N/2) 



7 



1 - 



N Nf3x 



N Nf3x 



Eh [pi^\h{x)]dx 
pi^ {x)dx 



(36) 



r(7V/2) 

where pi^{x) = £'h[p;„|h(2;)] is the normalized SR-PDF averaged over the ensemble of h. 

Fig. |9] is the normalized average SR-PDF for several codes investigated in this paper. In these examples, fuUy 
interleaved Rayleigh flat fading channel is considered. The elements of h are i.i.d. Rayleigh random variables with 
pdf 

Ph{h,) = 2h,e-''" , h,>0, i = l,2,--- ,7V (37) 
Fig. |9] indicates that the average SR-PDF in fully interleaved Rayleigh flat fading channel still keeps the same shape 



as in AWGN channel. Therefore, the approximations presented in Section IV, i.e. (32i and (34i can also be used to 
evaluate the average WER in flat fading channels, only with a and b replaced by a and b respectively, which are 
averaged over all channel gain realizations. Table II lists the mean and variance of the average and a, b used in 



32\ and ( 34 1 in Rayleigh flat fading channel. 



Fig. 10 is the comparison between simulation WER and (36i, (32i, (34i. It is obvious that the SR-PDF method 
and its approximations are still apphcable in flat fading channel. 



VII. Conclusion 

SR-PDF of decision region introduces a new method to evaluate the performance of binary block codes. The 
WER can be calculated using this pdf precisely, and even the closed-form approximations are more precise than 
existing tightest bounds for practically used long block codes at SNRs of interesting. Despite that the SR-PDF 
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method is demonstrated with binary codes in AWGN and flat fading channel in this paper, it is straightforward 
to generahze this method to any situations where the error rate is characterized by the decision region, such as 
memory less modulation, MIMO detection, coded-modulation, equahzation, etc. In these situations, the decision 
region may not have the same shape for different transmitted signals. Nevertheless, the average error rate can still 
be evaluated by the average SR-PDF in a similar way as in fading channel. 
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TABLE I 

The Critical SNR and (e=0.01) for some codes. 



Codes 


Critical SNR {Eh/No^^) 


A(,(dB) 


upper bound of Aj((iB) 


Turbo 1152 1/3 (Log-MAP) 


0.09 


1.65 


5.80 


Turbo 576 1/3 (Log-MAP) 


0.03 


2.12 


9.88 


Turbo 1152 1/2 (Log-MAP) 


0.76 


1.64 


4.54 


LDPC 1152 1/2 (SPA) 


0.92 


1.15 


4.46 


LDPC 1152 3/4 (SPA) 


2.22 


1.21 


3.73 



* The parameters /i;^ and used to calculate the critical SNR and the upper bound are listed in table 



TABLE 11 

Parameters of normalized SR-PDF for representative error control codes in AWGN channel 



codes 


decoding algorithm 


mean 


variance 


a 


b 


Turbo 1152 1/3 


Log-MAP 


1.47 


1.47e-2 


147.45 


l.OOe-3 


Turbo 1152 1/2 


Log-MAP 


0.84 


3.25e-3 


219.55 


3.85e-3 


Turbo 1152 1/2 


Max-Log-MAP 


0.79 


3.06e-3 


202.18 


3.89e-3 


Turbo 576 1/3 


Log-MAP 


1.49 


2.94e-2 


75.39 


1.98e-2 


Turbo 576 1/3 


Max-Log-MAP 


1.39 


2.81e-2 


68.21 


2.03e-2 


Turbo 576 1/2 


Log-MAP 


0.85 


6.30e-3 


115.23 


7.40e-3 


Turbo 1152 2/3 


Log-MAP 


0.51 


1.13e-3 


233.37 


2.20e-3 


Turbo 1152 3/4 


Log-MAP 


0.40 


7.84e-4 


204.04 


1.96e-3 


LDPC 1152 1/2 


Sum-Product 


0.81 


2.93e-3 


221.19 


3.64e-3 


LDPC 1152 1/2 


Min-Sum 


0.72 


2.13e-3 


245.43 


2.95e-3 


LDPC 1152 3/4 


Sum-Product 


0.40 


5.25e-4 


298.66 


1.33e-3 


LDPC 1152 3/4 


Mean-Sum 


0.37 


4.76e-4 


286.14 


1.29e-3 


LDPC 1152 2/3 


Sum-Product 


0.50 


8.89e-3 


280.85 


1.78e-3 


Convolution 576 1/4 


Viterbi-Soft 


2.13 


1.68e-l 


27.08 


7.88e-2 


Convolution 576 1/3 


Viterbi-Soft 


1.45 


6.01e-2 


34.85 


4.15e-2 


Convolution 576 1/2 


Viterbi-Soft 


0.82 


1.45e-2 


46.68 


1.76e-2 



February 2, 2008 



DRAFT 



14 



Fig. 1. Decision region of s and its radius for two dimensional codes. 



Fig. 2. Normalized SR-PDF of Turbo codes for different (a) decoding algorithm; (b) iterations; (c) code rate; (d) codeword length. "Turbo 
1152 1/3" stands for a turbo code with code rate 1/3 and codeword length 1152. 
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(a) (b) 

Fig. 3. Comparison of tlie simulated WER and tlie WER evaluated with jlO^ in AWGN channel. (a)The same Turbo codes with different 
maximum iterations. A'^ = 576, R = 1/3, decoding algorithm is Log-MAP and Max-Log-MAP; (b)Different codes, including Convolutional 
codes. Turbo codes and LDPC codes. 



Fig. 4. EXIT chart for the LDPC code in Table |l] The codeword length is 11520 and degree distribution is the same as the 1/2 rate LDPC 
code of Table |l| 1^^ and 1^^ are the a priori and extrinsic mutual information between the transmitted signal and the soft information input to 
variable nodes and output from check nodes respectively. Ie^ and Ia^ are the extrinsic and a priori mutual information between the transmitted 
signal and the soft information output from variable nodes and input to check nodes respectively. 
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TABLE m 

Parameters of average normalized SR-PDF for representative error control codes in Rayleigh flat fading channel 



codes 


decoding algorithm 


mean 


variance 


a 


b 


Turbo 1152 1/3 


Log-MAP 


0.935 


1.12e-2 


77.70 


1.20e-2 


Turbo 1152 1/2 


Log-MAP 


0.442 


2.89e-3 


67.59 


6.54e-3 


Turbo 576 1/3 


Log-MAP 


0.958 


2.30e-2 


39.70 


2.41e-2 


LDPC 1152 1/2 


Sum-Product 


0.419 


2.27e-3 


77.18 


5.43e-3 



Fig. 5. Illustration of Pe|e(/3«„) and («„).(/3i > 02). 



Fig. 6. Critical SNR and A,,. WER is the simulation result. Critical SNR is estimated by 1/fii^. Ac is calculated from j24| 
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Fig. 7. Comparison of WER between simulation and approximation using {32) for Convolutional codes. Turbo codes and LDPC codes 
in AWGN channel. The decoding algorithms are soft decision Viterbi decoding for Convolutional codes, Sum-Product algorithm (SPA) and 
Min-Sum algorithm (MSA) respectively with 25 maximum iterations for LDPC codes and Log-MAP with 8 maximum iterations for Turbo 
codes. 



Fig. 8. Comparison of WER between simulation and approximation using j34) for Convolutional codes. Turbo codes and LDPC codes 
in AWGN channel. The decoding algorithms are soft decision Viterbi decoding for Convolutional codes, Sum-Product algorithm (SPA) and 
Min-Sum algorithm (MSA) respectively with 25 maximum iterations for LDPC codes and Log-MAP with 8 maximum iterations for Turbo code. 
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Fig. 9. Normalized average SR-PDF pi^ (x) for several representative error control codes in Rayleigh flat fading channel. 



Fig. 10. Comparison of WER between simulation and approximations of Turbo codes, LDPC codes in Rayleigh flat fading channel. The 
decoding algorithms are Log-MAP with 8 maximum iterations for Turbo codes and SPA with 25 maximum iterations for LDPC codes. Solid: 
simulation; Dashed: approximation using {36) ; Dash dot: approximation using l |34) ; Dotted: approximation using j32| 



DRAFT 



February 2, 2008 



